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RESOURCE EF F^IENT HARDWARE LOOPS 

BACKGROUND 

In designing a programmable processor, such as a 
5 digital signal processing (DSP) system, two competing 

design goals are processing speed and power consumption. 
Conventional processors include a variety of hardware 
designed to increase the speed at which software 
instructions are executed. The additional hardware, 
10 however, typically increases the power consumption of the 
processor. 

One technique for increasing the speed of a 
programmable processor is a "hardware loop," which may be 
dedicated hardware designed to expedite the execution of 

15 software instructions within a loop construct. Hardware 
loops may reduce the number of clock cycles used to 
execute a software loop by caching the instructions in 
local registers, thereby reducing the need to fetch the 
same instruction from a memory device or instruction cache 

20 a plurality of times. 
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DESCRIPTION OF DRAWINGS 
Figure 1 is a block diagram illustrating an example 
of a programmable processor adapted according to an 
embodiment of the invention. 
5 Figure 2 is a block diagram illustrating a pipeline 

in accordance with an embodiment of the invention. 

Figure 3 is flow diagram illustrating an example 
process of loading early registers in accordance with an 
embodiment of the invention. 
10 Figure 4 is a block diagram illustrating the 

efficient use of one or more pipelines in accordance with 
an embodiment of the invention. 

Figure 5 is a flow diagram illustrating one example 
use of a loop setup instruction to determine early 
15 register values in accordance with an embodiment of the 
invention. 

Figure 6 is a circuit block diagram illustrating one 
embodiment of a hardware loop unit. 

Figure 7 is a flow diagram illustrating the reuse of 
20 hardware in accordance with an embodiment of the 
invention . 
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DESCRIPTION 



FIG. 1 is a block diagram illustrating a programmable 
processor 2 arranged to support efficient hardware loops 
in- accordance with an embodiment of the invention. 
Processor 2 may include a control unit 6 that sends 
control signals to pipelines 4. Control unit 6 may 
include hardware loop unit 8 that may facilitate fast 
hardware loops without significantly increasing power 
consumption of processor 2. 

In order to support hardware loops, a processor 2 may 
support a loop setup instruction that initializes 
hardware, such as a hardware loop unit 7, by setting entry 
and exit conditions for the loop. Entry and exit 
conditions may be defined by loop conditions: top, bottom 
and count. The top condition may define a first 
instruction (or top) of the loop. The bottom condition 
may define a last instruction (or bottom) of the loop. 
And the count condition may define a number of iterations 
of the loop. 

Entry of a hardware loop may occur at the first "top 
match." A top match may occur when a program counter (PC) 
points to the top instruction of the loop. Exit of the 
hardware loop may occur at the last "bottom match," which 
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may occur when the PC points to the bottom instruction of 
a loop. 

By initializing the count at the first top match and 
decrementing the count at each bottom match, the hardware 
may keep track of when ' it has encountered the last bottom 
match. In this manner, the loop conditions top, bottom 
and count may define the entry and exit conditions of the 
hardware loop. 

Processor 2 may include one or more pipelines 4 and a. 
control uifit 6. By way of example, the pipelines 4 may 
include orle or more system pipelines, one or more data 



address ge 
pipelines , 
desired fo 



eration pipelines, one or more execution unit 
and one or more additional pipelines as may be 
c a particular implementation. Control unit 6 
may control the flow of instructions and/or data through 
the pipelines 4 during a clock cycle. For example, during 
sing of an instruction, control unit 6 may 
various components of the pipelines to decode 
the instri ction and correctly perform the corresponding 
operation including, for example, writing the results back 
to meraej^. 

Instructions may be loaded into a first stage of one 
or more pipelines 4 and processed through subsequent 
stages. A stage may process concurrently with the other 



the proces 
direct the 
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stages. Data may pass between the stages in pipelines 4 
during a cycle of the system. The results of an 
instruction may emerge at the end of the pipelines 4 in 
rapid succession. 
5 FIG. 2 is a block diagram illustrating an example 

pipeline in accordance with an embodiment of the 
invention. A pipeline 10 has multiple stages that may 
facilitate execution of multiple instructions during a 
single clock cycle. In pipeline 10, an instruction may 

10 . enter the instruction fetch (IF) stage 12 during a first 
clock cycle. The instruction may then continue down the 
pipeline during subsequent clock cycles. Typically, 
another instruction enters the IF stage 12 during a 
subsequent clock cycle, and then continues down the 

15 pipeline during subsequent clock cycles. Similarly, 
additional instructions enter the IF stage 12 during 
subsequent clock cycles respectively. The number of 
stages in the pipeline may define the number of 
instructions that the pipeline may service simultaneously. 

20 The different stages of the pipeline may operate as 

follows. Instructions may be fetched during the IF stage 
12 by a fetch unit 13 and decoded from instruction 
registers 15 during the DEC stage 14. During the AC stage 
18, one or more data address generators 19 may calculate 
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any memory addresses used to perform the operation. A 
data address generator 19 may contain one or more 
arithmetic logic units (ALU's) to facilitate the 
calculation . 

During the execution stages (EX 1 - EX n) 22A - 22N, 
execution units 23 and 29 may perform specified operations 
such as, for example, adding or multiplying two numbers. 
Execution units may contain specialized hardware for 
performing the operations including, for example, one or 
more ALU's, floating-point units (FPU) and barrel 
shifters, although the scope of the invention is not 
limited in this respect. A variety of data may be applied 
to the execution units such as the addresses generated by 
data address generators, data retrieved from memory or 
data retrieved from data registers. During write back 
stage (WB) 30, the results may be written to a memory 
location or data registers external to the pipeline or to 
data registers in the pipeline such as architectural 
registers 32. The stages of pipeline 10 may include one 
or more storage circuits, such as a flip-flop, for storing 
data. 

As mentioned above, processor 2 may support a loop 
setup instruction. The loop setup instruction may 
initialize a hardware loop by writing the boundaries of 
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the hardware loop (e.g. top and bottom) to architectural 



registers 32. 



The loop setup instruction may also 



initialize a count in architectural registers 32, 



indicating the number of times the loop is to be 



5 



completed. In addition, the loop setup instruction may 



define an offset, indicating the number of instructions 
that follow the loop setup instruction before the top of 
the loop is reached. After the hardware loop is 
initialized, the hardware loop may operate in the pipeline 



(e.g. a bottom match with count equal to zero). 

Architectural registers 32 are generally loaded once 
an instruction has committed, e.g., when the loop setup 
instruction exits the WB stage 30. Therefore, the entry 

15 and exit conditions stored in architecture registers 32 

may not be updated until several clock cycles have passed 
from when the loop setup instruction enters pipeline 10. 
Because the entry and exit conditions may not be updated 
until several clock cycles have passed, delays on setting 

20 up hardware loops may exist. For example, if the first 

instruction in the loop enters pipeline 10 before the loop 
setup instruction has committed, the architectural 
registers may not be set up to identify, the instruction as 



10 



10 until the exit condition of the loop has been satisfied 
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part of a. loop. Moreover, this may increase as the depth 
of the pipeline increases. 

In one embodiment, processor 2 may address these 
issues by maintaining a set of early registers 34 in the 
5 pipeline. As shown in FIG. 2, early registers ETop 34A 

and EBot 34B may reside in the decode stage while ECnt 34C 
may reside in AC stage. 

Implementing a set of early registers 34 may increase 
processing speed of processor 2 by reducing or avoiding 

10 loop set up penalties. As described above, several clock 
cycles may pass between the time a loop setup instruction 
enters the pipeline and the time the architectural 
registers are written. However, the early registers may 
be loaded long before the loop setup instruction writes to 

15 the architectural registers. For this reason, 

implementing early registers may reduce the time it takes 
to setup hardware loops. 

The early registers may be speculative registers used 
to predict or speculate the value of architectural 

20 registers. Unlike the architectural registers, the 

speculative registers may not be supported by the system's 
instruction set. Therefore, program code may not be used 
to access the speculative registers. For this reason, a 
programmer may not be able to move data in or out of the 
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speculative registers the same way that he or she could 
with architectural registers. 

Loading early registers may be done in several 
different ways. For instance, the early registers may be 
5 loaded simply as a result of performing a regular 

instruction register move to the architectural registers. 
In other words, • the system may instruct the architectural 
registers to load the contents of some other register, and 
as a result, the early registers may be updated. Yet 
10 another way to load the registers is to load them from 
memory. In other words, the system may fetch the data 
from memory, load the architectural registers with that 
data, and update the early registers. 

The problem with regular register moves or loads from 
15. memory, however, is that they may introduce loop setup 

penalties. These penalties may occur because the system 
may stall the pipeline until the data is available to be 
written. To avoid these penalties, a loop setup 
instruction may be used to load the early registers before 
20 the architectural registers get written. 

The following example illustrates the syntax for 
invoking an exemplary loop setup machine instruction: 
LSETUP (PC Relative Top, PC Relative Bottom) Counter = X 
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The PC Relative Top specifies the distance from the 
current instruction to the start of the loop (the Start 
Offset) . The PC Relative Bottom specifies the distance 
from the current instruction to the end of the loop (the 
End Offset) . In addition, the Counter variable may 
specify a counter register and a loop count indicating the 
number of iterations in the loop. 

FIG. 3 is a flow diagram illustrating the timing of 
loading early registers in accordance with an embodiment 
of the invention. As described, the loop setup 
instruction may contain loop conditions in the form of a 
count value, a top value, and a bottom value. 
Collectively, these three values may define entry and exit 
conditions, of a hardware loop. 

The count value may represent the number of 
iterations that the. loop will make. Once the loop setup 
instruction enters AC (38), the count value may be written 
to the ECnt register (39) . Initially writing to the ECnt 
register may be done via a register move from data 
registers. In one mode of operation, the ECnt register 
may be written with data contained in pointer registers 
(PREGS) of a data address generation (DAG) pipeline. If 
necessary, an ALU in one of the pipelines may be used to . 
calculate the count value from the loop setup instruction. 
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ie top and bottom values may indicate which 
instruction is the top of the loop, and which instruction 
is the bottom of the loop. The top and bottom values in 
the loop setup\instruction, however, may be program 
counter (PC) relative. Therefore, a calculation (40) in 
AC stage may be usedN:o obtain the top and bottom values 
that will be written to\Top 34A and .EBot 34B registers 
respectively. After the lo^p setup instruction enters EX 
1 (41), the top and bottom valVs may be written to the 
ETop 34A and EBot 34B registers (4^) . 

In accordance with an embodiment of the invention, 
system resources may be efficiently implemented. In this 
manner, the need for additional system hardware to handle 
hardware loops may be avoided. As mentioned above, the 
loop conditions of a hardware loop may be contained in a 
loop setup instruction. By efficiently reusing available 
ALU's contained in the processor, hardware loops may be 
set up without the need • for dedicated hardware loop ALU's. 

FIG. 4 is a block diagram illustrating the efficient 
use of one or more pipelines in accordance with an 
embodiment of the invention. A loop setup instruction may 
be fetched during the IF stage by a fetch unit and decoded 
from instruction registers (not shown) during the DEC 
stage 14. At this point, the loop setup instruction may 
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be piped to available ALU's (50, 51) in different 
pipelines so that the loop conditions may all be 
calculated in parallel. 

For instance, in one particular embodiment, an ALU 52 
in a first pipeline (e.g. a first DAG pipeline 60) may be 
used to pass the count value and may perform any necessary 
shifting or calculation. In addition, an ALU 50 in a 
second pipeline (e.g. a second DAG pipeline 62) may be 
used to calculate the bottom value of a loop from the loop 
setup instruction. Moreover, an ALU 51 in a third 
pipeline (e.g. one contained in the branch unit 54 of a 
system pipeline 64) may be used to calculate the top value 
of a loop from the loop setup instruction. In this 
manner, the loop conditions may be calculated in parallel. 
Moreover, the respective ALU's may all be resources that 
are available whether or not the system is configured to 
handle hardware loops. Thus, by reusing these available 
resources, the forgoing. implementation may avoid 
unnecessary increases in hardware to handle hardware 
loops . 

After the loop conditions have been calculated, these 
conditions may be written to a set of early (or 
speculative) registers 34. The ETop register 34A may be 
loaded to point to the first instruction of the loop (or 
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top of the loop) . The EBot register 34B may be loaded to 
point to the last instruction of the loop (or bottom of a 
loop) . The ECnt register 34C may be loaded to specify the 
number of times that the loop is to be repeated. In one 
embodiment, ECnt 34C* counts downward, decrementing each 
time a bottom match is encountered. 

In addition to writing the calculated loop conditions 
to the early registers 34, this data may also be piped to 
a set of architectural registers 32 that may get written 
in the write back stage. In accordance with' another 
embodiment of the invention, this data may be piped down a 
number of available pipelines. In this manner, two or 
more of the architectural .registers 32 may be written in 
parallel. Moreover, additional storage hardware (such as 
additional flip-flops) may be unnecessary to carry the 
loop conditions to WB. 

In one particular embodiment, a first pipeline (e.g., 
DAG pipeline 60) may be used to carry the count variable 
to an architectural register 32A. In addition, a second 
pipeline (e.g., DAG pipeline 62) may be used to carry the 
top variable to an architectural register 32B. Moreover, 
a third pipeline (e.g., system pipeline 64) may be used to 
carry the bottom variable to an architectural register 
32C. These respective pipelines may all be resources that 
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are available whether or not the system is arranged to 
handle hardware loops. Thus, by reusing these available 
resources, the forgoing implementation may avoid 
unnecessary increases in hardware to handle hardware 
loops . 

Reusing the pipelines realizes several advantages. 
For instance, if only a single pipeline were used to 
calculate the loop conditions, it might take several clock 
cycles to perform all necessary calculations using a single 
ALU. Moreover, if only a single pipeline were used to 
propagate the loop conditions, it may take additional clock 
cycles to pass the data to WB . For these reasons, the 
reuse of additional pipelines may provide for improved 
system performance by avoiding these additional loop setup 
penalties. In addition, as described above, reusing 
existing pipelines may realize a reduction in hardware 
within the processor. Moreover, it may facilitate writing 
loop conditions to two or more registers in parallel. 

FIG. 5 is a flow diagram illustrating one mode of 
operation of calculating early register values in 
accordance with an embodiment of the invention. According 
to one format, the loop setup instruction may specify 
several setup variables including a Start Offset (S- 
Offset) and an End Offset (E-Offset) . The S-Offset may 
specify the distance in the instruction stream from the 
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loop setup instruction to the first instruction in the 
loop. Similarly, the E-Offset may specify the distance in 
the instruction stream from the loop setup instruction to 
the last instruction in the loop. 
5 For instance, if the first instruction in the loop is 

the instruction immediately following the loop setup 
instruction, then the S-Offset would be the width of the 
loop setup instruction. If, in the instruction stream, 
there is one instruction between the loop setup' 
10 instruction and the first instruction in the loop., then 
the S-Offset would be the width of the loop setup 
instruction and the one instruction. Similarly, if there 
are two instructions between loop setup and the first 
instruction, then the S-Offset would be width of the loop 
15 setup instruction and the two instructions. 

As shown in FIG. 5, the S-Offset and E-Offset are 
typically specified by a loop setup instruction (74). 
However, the loop-setup instruction specifies the offsets 
relative to the program counter (PC) . Therefore, the PC 
20 value may also be determined (75). The PC value and S- 
Offset may then be used to calculate ETop register data 
(76) . Moreover, the PC value and E-Offset may be used to 
calculate EBot register data (77) . Once calculated, the 
early register data may be written to the early registers 
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(78). Again, by reusing available ALU's in the system, 
the early register data may be calculated in parallel, and 
done so without an unnecessary hardware increases. 

Comparing FIG. 5 with FIG. 2 illustrates exemplary 
timing when writing the ETop and EBot registers. Steps 
(74) and (75) may occur in DEC stage 14. Calculations 
steps (76) and (77) may occur in AC stage 18. Therefore, 
the write step (78) may occur in EX 1 stage 22A. 

Once loaded, the early registers may be used to set 
up hardware loops. FIG. 6 is a block diagram illustrating 
one embodiment of a hardware loop unit 7 connected to an 
instruction fetch (IF) unit 13 and a decoder unit 17 of 
pipeline 10. In one embodiment, the early registers may 
be used to detect a loop in the stream of instructions 84. 
Loop hardware 8 6 may then be loaded with one or more loop 
instructions. Once loaded, the loop instructions may be ^ 
issued again and again from loop hardware. Thus, if a 
hardware loop is detected, then one or more of the loop 
instructions may be fetched only once by IF unit 13, and 
then issued repeatedly from hardware loop unit 7. 

FIG. 7 is a flow diagram illustrating the reuse of 
hardware in accordance with an embodiment of the 
invention. Using available hardware, when a loop setup 
instruction is received, a first loop condition and a 
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second loop condition may be calculated in parallel (102 
and 104) . These conditions may be calculated, for 
instance, using first and second arithmetic logic units 
(ALUs ) . Moreover, these ALUs may reside in different 
pipelines. Alternatively, additional loop conditions may 
be calculated using additional ALUs residing in other 
available pipelines. 

Once the loop conditions have been calculated (102 
and 104), they' may be written to speculative registers 
(106) and used to set up a hardware loop. In addition, 
the loop conditions may be propagated to a set of 
architectural registers via a first pipeline and a second 
pipeline respectively (108 and 110). If additional loop 
conditions need to be propagated, additional pipelines may 
be used. Once propagated, the loop conditions may be 
written to a set of architectural registers (112). 

Calculating loop conditions from a loop setup . 
instruction may require the use of one or more ALUs. 
Moreover, propagating the calculated conditions to a set 
of architectural registers may require storage circuitry 
(e.g. a flip flop) at every pipe stage, for every loop 
condition. By efficiently implementing available system 
resources, hardware loops may be setup without the need 
for additional hardware loop ALUs and flip-flops. 
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Various embodiments of the invention have been 
described. For example, the reuse of hardware not 
traditionally used in a hardware loop context has been 
described for implementation within a processor. The 
processor may be implemented in a variety of systems 
including general purpose computing systems, digital 
processing systems, laptop computers, personal digital 
assistants (PDA's) and cellular phones. In this context, 
the> reuse of hardware discussed above may be readily used 
to facilitate efficient hardware loops. In such a system, 
the processor may be coupled to a memory device, such as a 
FLASH memory device or a static random access .memory 
(SRAM) that stores an operating system and other software 
applications. These and other embodiments are within the 
scope of the following claims. 



